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1.  Introduction 


Multidisciplinary  weapon-target  interaction  problems  (from  first  principles)  require  solutions  of 
complex  and  very  large-scale  equations  and  the  use  of  parallel  computers.  Examples  such  as 
blast-structure  interaction  and  projectile-buried  structure  interaction  require  coupling  of  solvers 
for  a  variety  of  physics  applications  in  order  to  provide  a  complete  understanding  of  the  detailed 
interaction. 

A  large  class  of  these  computational  problems  do  not  neatly  fit  into  a  pure  Eulerian  or  pure 
Lagrangian  approach.  Arienti  et  al.1  point  out  that  Eulerian  approaches  are  excellent  at  allowing 
for  the  development  of  a  complex  flow,  at  the  price  of  loss  in  accuracy,  when  tracking  a 
boundary.  Lagrangian  approaches  intrinsically  track  the  boundary,  but  lose  accuracy,  when  the 
mesh  becomes  highly  distorted.  Hybrid  methods  such  as  Arbitrary  Lagrangian  Eulerian  (ALE) 
attempt  to  combine  the  two  methods,  but  ALE  suffers  from  its  own  set  of  problems  and  may  be 
difficult  to  implement  between  existing,  separate  Eulerian  and  Lagrangian  software  systems. 

For  example,  to  address  blast-structure  multidisciplinary  applications,  the  blast  component 
requires  an  Eulerian  (i.e.,  fluid  dynamics)  approach  and  the  structure  component  requires  a 
Lagrangian  ( i.e.,  structural  mechanics)  approach.  Such  applications  typically  involve  one  or 
more  material  regions  that  undergo  relatively  small  deformations,  while  other  regions  of  the 
problem  undergo  arbitrarily  large  deformations.  These  simulations  are  traditionally  perfonned 
by  transferring  data  files  from  one  software  package  to  another,  resulting  in  one-way  coupling. 
This  practice  is  very  time  consuming  for  addressing  practical  applications. 

The  Zapotec*  coupled  Euler-Lagrange  code2  employs  CTH  as  its  Eulerian  component  and 
Proton3D'l  as  its  Lagrangian  component.  This  single,  combined  code  provides  a  two-way 
coupling  between  the  Eulerian  and  Lagrangian  domains.  Zapotec  can  be  used  for  problems  in 
which  the  response  of  the  Lagrangian  structure  does  not  affect  the  load  applied  by  the  Eulerian 
flow  field  (one-way  coupling).  One  limitation  of  Zapotec  is  that  it  does  not  allow  shell  elements 


Zapotec.  Sandia  National  Laboratories. 

'  Proto3D.  Sandia  National  Laboratories. 

1  Arienti,  M.;  Hung,  P.;  Morano,  E.;  Shepherd,  J.  A  Level  Set  Approach  to  Eulerian-Lagrangian  Coupling.  Journal  of 
Computational  Physics  2003,  185  (1),  213-251. 

2 

“  Bessette,  G.  C.;  Vaughan,  C.  T.;  Bell,  R.  L.  Zapotec:  A  Coupled  Euler-Lagrange  Code  for  Modeling  Earth  Penetration. 
Proceedings  of  the  73rd  Shock  and  Vibration  Symposium ,  Newport,  RI,  1 8-22  November  2002. 
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to  be  used  in  the  Lagrangian  model.  Furthermore,  the  computational  overhead  of  the  two-way 
coupling  and  the  complexity  of  setting  up  a  Zapotec  simulation  may  be  prohibitive  to  solving  a 
problem  for  which  a  one-way  coupling  approach  would  suffice. 

Consequently,  an  easy-to-use  method  of  one-way  coupling  of  CTH  to  a  Lagrangian  code  that 
offers  shell  element  capability  would  be  a  valuable  tool  for  a  variety  of  defense  applications. 
This  report  describes  the  development  of  such  a  method. 


2.  A  New  Approach 


The  requirement  of  an  end-to-end  simulation  capability  for  weapon-target  interaction 
applications  revealed  the  need  for  a  seamless  interdisciplinary  capability.  An  interdisciplinary 
capability  can  be  addressed  either  by  developing  coupled  software  from  scratch  or  by  integrating 
existing  legacy  software.  The  first  approach  involves  developing  and  testing  the  entire  software 
spectrum,  which  is  time  consuming  and  may  require  more  time  to  reach  the  end  user.  The 
second  approach  involves  coupling  existing  software  from  individual  disciplines,  which  takes 
advantage  of  the  tremendous  “stove-pipe”  developments  already  made  in  computer  science  and 
general  computational  sciences.  This  latter  approach  requires  data  management,  seamless  data 
movement,  and  robust  modular  scalable  algorithms,  and  is  the  central  theme  of  this  achievement. 
To  address  this  problem,  a  research  effort  entitled,  “Interdisciplinary  Computing  Environment 
for  Weapon-Target  Interaction”  was  undertaken  to  produce  an  entirely  new  capability. 

The  uniqueness  and  significance  of  the  research  contribution  in  the  newly  developed 
Interdisciplinary  Computing  Environment  approach  is  the  development  of  a  common  data  hub, 
which  is  both  a  data  model  and  data  format.  That  means  the  information  about  the  data  values 
and  “how  the  data  are  used”  are  available.  Known  as  the  extensible  Data  Model  and  Format 
(XDMF),  the  data  hub  utilizes  XML  and  hierarchical  data  fonnat  version  5  (HDF5)  to  provide  a 
flexible  yet  powerful  active  data  hub,  as  shown  in  figure  1 .  The  transfer  of  data  is  handled  by  a 
distributed  shared-memory  system  called  Network  Distributed  Global  Memory  (NDGM),  which 
provides  access  to  a  virtual,  contiguous  buffer  through  a  client-server  architecture.  A  widely 
used  HDF5  is  used  to  provide  an  NDGM  buffer  with  a  structure.  The  common  data  hub  facility 
provided  by  HDF5  and  NDGM  is  effectively  used  to  manage  data  between  different  software 
systems  and  to  coordinate  activities  between  different  codes.  This  enables  researchers  and 
engineers  to  quickly  couple  production  level  parallel  high-performance  computing  codes  from 
different  disciplines  and  ultimately  develop  coupled  algorithms  and  approaches  for  addressing 
both  one-way  coupled  and  fully  coupled  weapon-target  interaction  applications  in  a  seamless 
way. 
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Figure  1.  XDMF. 


3.  One-Way  Coupling 


To  address  the  requirement  of  one-way  coupled  land  mine-vehicle  structure  interaction,  this 
capability  has  been  used  to  couple  the  finite-element  code  LS-Dyna*  (a  commercial  software) 
with  the  finite  volume  shock  physics  code  CTH  (Department  of  Energy  software).  This  allows 
the  strengths  of  both  codes  to  be  utilized  to  produce  a  result  that  is  not  possible  by  either  code 
separately.  CTH  is  widely  used  for  modeling  the  dynamic  loading  on  a  structure  as  a  result  of 
the  detonation  of  an  explosive,  while  LS-Dyna  is  an  appropriate  tool  for  simulating  the  large 
deformation  of  a  thin  structure,  such  as  a  vehicle  hull. 

This  type  of  one-way  coupling  is  appropriate  for  this  particular  application  because  the 
deformation  of  the  structure  occurs  at  a  rate  such  that  it  has  little  effect  on  the  developing  blast, 
but  the  blast  has  a  significant  impact  on  the  deformation  of  the  structure.  This  approach  was 
automated  and  used  by  the  U.S.  Army  Research  Laboratory  (ARL)  Weapons  and  Materials 
Research  Directorate  researchers  to  complete  these  analyses  and  not  only  improved  designs  and 
understanding  of  the  mine  blast-structure  interaction,  but  also  significantly  reduced  the  analysis 
cycle  time. 

Previous  efforts  have  attacked  the  specific  problem  of  one-way  coupling  the  Eulerian  shock 
physics  code  CTH  with  Lagrangian  finite-element  structural  response  codes.  Typically,  this 


LS-Dyna  is  a  registered  trademark  of  Livermore  Software  Technology. 
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involves  the  use  of  “tracer  points,”  which  is  a  specific  feature  of  the  Eulerian  code  and  difficult 
to  implement  in  the  general  sense.  In  addition,  these  methods  did  not  address  the  problem  of 
accurately  representing  complex  geometries  on  the  structured  Eulerian  mesh. 

In  addition  to  the  scalable  coupling  methods,  one  of  the  technical  challenges  was  to  use 
consistent  meshes  for  both  software  packages.  The  computational  domains  modeled  by 
individual  codes  are  entirely  different  and  not  easily  coupled  together.  Note  that  LS-Dyna  is  an 
unstructured  finite-element  approach  and  CTH  is  a  finite  volume-based  structured  mesh 
approach.  Typically,  armored  vehicle  hull  structures  are  geometrically  complex  and  are 
represented  using  unstructured  thin  “shell  elements.”  LS-Dyna  uses  shell  elements  to  represent 
thin  structures.  These  elements  have  no  thickness,  but  accurately  capture  the  deformations  of 
thin  structural  members  at  a  much  lower  computational  cost  than  using  many  small  hexahedral 
elements  through  the  thickness  of  the  structure.  CTH,  being  a  finite  volume  code  based  on  a 
structured  mesh,  has  no  concept  of  shell  elements.  Introducing  a  structure  composed  of  these 
elements  into  a  structured  mesh  presents  a  technical  challenge. 


4.  Preparing  Geometry 


As  shown  in  figure  2,  the  method  used  to  accomplish  this  task  starts  with  giving  these  shell 
elements  a  thickness  so  they  can  be  introduced  into  a  structured  mesh  while  still  maintaining  the 
shape  of  the  thin  structure.  This  is  done  by  extruding  each  quadrilateral  shell  element  in  the 
direction  opposite  its  “normal”  direction  (i.e.,  toward  the  inside  of  the  entire  structure).  The 
resulting  hexahedra  are  then  decomposed  into  tetrahedra  and  converted  into  a  data  format  that 
CTH  can  use  for  input. 


But  a  simple  extrusion  is  sometimes  insufficient.  If  the  shell’s  normals  are  used,  problems  arise 
if  adjoining  shell  normal  vectors  differ  significantly.  In  this  case,  the  back  side  of  the  extruded 
shell  can  extend  beyond  the  surface  of  the  adjoining  shell,  as  depicted  by  the  side  view  of  the  red 
and  blue  extruded  shells  below  in  figure  3.  To  alleviate  this  problem,  nonnal  vectors  are 
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Figure  3.  Normal  vectors  are  averaged  to  represent  the  surface  correctly. 


calculated  on  the  nodes  and  averaged.  New  node  positions  are  then  calculated  using  these 
vectors,  and  the  connectivity  is  generated. 

In  addition  to  the  newly  generated  geometry  for  material  insertion,  the  CTH  input  consists  of  a 
description  of  the  explosive  charge,  and  potentially  soil,  to  model  the  ground  plane  and  air 
surroundings.  CTH  uses  this  information  to  simulate  the  explosive  detonation  and  calculates  the 
pressure  loads  as  they  build  on  the  structure.  The  pressure  information  for  the  entire  mesh  is 
saved  to  the  common  data  model  and  format  XDMF  at  regular  intervals.  Once  the  load  on  the 
structure  has  dissipated,  the  CTH  calculation  is  halted. 


5.  Extracting  Pressure-Time  Histories 


Using  the  original  thin  shell  structure,  the  pressure  information  is  “probed”  in  order  to  generate  a 
pressure-vs.-time  history  for  each  of  the  shell  elements.  That  is,  data  are  mapped,  using 
interpolation,  from  the  structured  mesh  onto  points  at  the  center  of  the  shell  faces.  This 
information  can  then  be  input  into  the  LS-Dyna  calculation  to  simulate  the  structural  deformation 
that  will  result  from  the  explosion  impinging  on  the  vehicle  structure.  Sometimes  the  probed 
pressure  observed  directly  on  the  surface  can  oscillate  in  the  calculation.  It  is  usually  desirable 
to  probe  the  pressure  vales  just  off  of  the  surface.  For  this  reason,  the  pressure  values  are 
sampled  a  small  distance  in  the  direction  of  the  shell  normal  vector,  placing  them  into  the  blast 
field  and  off  of  the  surface.  This  is  depicted  in  figure  4. 


5 


Original  Shell  Positions 


Figure  4.  Pressures  are  probed  slightly  off  of  the  original  surface. 


6.  An  Example 


As  a  test  case,  a  complex  vehicle  hull  shape  was  taken  from  an  LS-Dyna  input  file  and  converted 
using  the  previously  described  method.  Shown  in  figure  5  is  the  original  structure  with  an 
isosurface  of  the  blast  from  CTH. 


Figure  5.  Mine  blast  interacting  with  vehicle  hull. 
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Since  there  were  experimental  results  available  for  this  configuration,  the  results  of  the  entire 
simulation  can  be  compared.  To  test  the  coupling  method  itself,  results  were  compared  with 
simple  geometries  that  could  be  accomplished  with  the  tracer  point  methods  described  earlier. 
Validation  of  the  entire  simulation  will  require  validation  of  many  factors,  including  the  blast 
and  material  models  in  both  CTH  and  LS-Dyna. 

The  process  was  accomplished  with  the  development  of  several  scripts  written  in  the  Python3 
scripting  language.  Python  provides  a  convenient  method  to  “glue”  together  many  smaller 
software  components.  For  example,  XDMF  access,  the  Visualization  Toolkit,4  and  the  various 
parsers  are  combined  to  create  a  single  tool,  without  re-compiling  or  linking  any  system  code. 

The  first  script  accomplishes  the  parsing  of  the  original  LS-Dyna  input  and  generates  an  XDMF 
dataset  of  the  extruded  tetrahedral  mesh.  The  next  script  uses  this  mesh  as  input  and  generates 
both  the  CTH  input  file  and  the  geometry  file  needed  for  material  insertion.  The  last  script 
processes  the  CTH  output  and  generates  the  pressure-vs.-time  histories  and  formats  them  for 
input  to  LS-Dyna. 


7.  Summary 


The  Interdisciplinary  Computing  Environment  provides  a  new  capability  for  the  physics-based 
simulation  of  weapon-target  interactions.  This  new  capability  is  being  used  at  ARL  in 
armor/anti-armor  designs  and  survivability  of  new  systems  against  land  mine  threats. 


a 

Python  home  page,  http://www.python.org  (accessed  18  May  2004). 

4  Schroeder,  W.;  Martin,  K.;  Lorensen,  B.  The  Visualization  Toolkit  2nd  Eds;  Prentice  Hall  PTR:  Upper  Saddle  River,  NJ, 
1998. 
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